EÆcient EM Learning with Tabulation for Parameterized Logic Programs
نویسندگان
چکیده
We have been developing a general symbolic-statistical modeling language [6, 19, 20] based on the logic programming framework that semantically uni es (and extends) major symbolic-statistical frameworks such as hidden Markov models (HMMs) [18], probabilistic contextfree grammars (PCFGs) [23] and Bayesian networks [16]. The language, PRISM, is intended to model complex symbolic phenomena governed by rules and probabilities based on the distributional semantics[19]. Programs contain statistical parameters and they are automatically learned from randomly sampled data by a specially derived EM algorithm, the graphical EM algorithm. It works on support graphs representing the shared structure of explanations for an observed goal. In this paper, we propose the use of tabulation technique to build support graphs, and show that as a result, the graphical EM algorithm attains the same time complexity as specilized EM algorithms for HMMs (the Baum-Welch algorithm [18]) and PCFGs (the Inside-Outside algorithm [1]).
منابع مشابه
Developing Finite Domain Constraints - A Data Model Approach
Syntax for Variable Binders: An Overview . . . . . . . . . . . . . . . . . . . . 239 Dale Miller Goal-Directed Proof Search in Multiple-Conclusioned Intuitionistic Logic . . 254 James Harland, Tatjana Lutovac, and Michael Winikoff Efficient EM Learning with Tabulation for Parameterized Logic Programs . 269 Yoshitaka Kameya and Taisuke Sato Model Generation Theorem Proving with Finite Interval C...
متن کاملParameter Learning of Logic Programs for Symbolic-Statistical Modeling
We propose a logical/mathematical framework for statistical parameter learning of parameterized logic programs, i.e. de nite clause programs containing probabilistic facts with a parameterized distribution. It extends the traditional least Herbrand model semantics in logic programming to distribution semantics , possible world semantics with a probability distribution which is unconditionally a...
متن کاملParameterized Logic Programs where Computing Meets Learning
In this paper, we describe recent attempts to incorporate learning into logic programs as a step toward adaptive software that can learn from an environment. Although there are a variety of types of learning, we focus on parameter learning of logic programs, one for statistical learning by the EM algorithm and the other for reinforcement learning by learning automatons. Both attempts are not fu...
متن کاملFuzzy adaptive tracking control for a class of nonlinearly parameterized systems with unknown control directions
This paper addresses the problem of adaptive fuzzy tracking control for aclass of nonlinearly parameterized systems with unknown control directions.In this paper, the nonlinearly parameterized functions are lumped into the unknown continuous functionswhich can be approximated by using the fuzzy logic systems (FLS) in Mamdani type. Then, the Nussbaum-type function is used to de...
متن کاملYet More Efficient EM Learning for Parameterized Logic Programs by Inter-Goal Sharing
In previous research, we presented a dynamicprogramming-based EM (expectation-maximization) algorithm for parameterized logic programs, which is based on the structure sharing with tabled search. It is also shown that this general framework achieves the same time complexity as that of the specialized algorithms. The efficiency is brought by sharing common (partial) paths in the derivation tree ...
متن کامل